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METHOD AND APPARATUS FOR DISPLAYING AN IMAGE ON A DISPLAY 
WITH A DIFFERENT ASPECT RATIO THAN THE IMAGE 

STATEMENT OF RELATED APPLICATION 

[0001] This application claims the benefit of priority to U.S. Provisional Patent 
Application 60/442,279, filed January 24, 2003 by the same inventor, and entitled "Pre- 
setable Audio Gain Setting To Compensate For Program Source Head Room Volume." 

FIELD OF THE INVENTION 

[0002] The present invention relates generally to methods and apparatuses for 
displaying images on a screen, and more particularly to a method and apparatus for 
displaying images on a screen in which the image is designed for one size and the screen 
is designed for a different size. 

BACKGROUND 

[0003] Generally, television programming is created for display on at least one of 

two types of screens - a traditional television sized screen, which has an aspect ratio of 

4:3 and a movie screen, sometimes referred to as letterbox sized, which has an aspect 

ratio of 16:9. High-end televisions for use with High Definition Television (HDTV) are 

now typically 16:9 in aspect ratio. As such, many efforts have been made to display 

conventional television programming in a way that is less disconcerting to viewers. For 

example, FIG 1 depicts a typical 16:9 aspect ratio image (black) displayed on a 4:3 aspect 

ratio screen (white). The image leaves two bars - one at the top and one at the bottom 

that can be disconcerting to viewers. Similarly, when a 4:3 aspect ratio image (blaclc) is 
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displayed on a 16:9 aspect ratio screen (white), there are two bars on the sides, as shown 
in FIG 2. 

[0004] Attempts to remedy this situation include zooming in the picture until the 
entire screen is filled, which can leave a significant portion of the image off the screen 
and unviewable, /.e, on the order of 25% of the image is unviewable, and thus lost. 
Other attempts include distorting the image in certain places so that the entire screen is 
filled with the image and nothing is lost, however, this can lead to image artifacts that are 
undesirable to some viewers. These artifacts include, for example, making people appear 
fatter. Many viewers find this unappealing, especially in a high-end television. 
[0005] The present invention is therefore directed to the problem of developing a 
method and apparatus for displaying an image on a screen for which the image is not 
designed in a manner that provides a non-distorted image yet generally pleasing viewing 
screen. 

SUMMARY OF THE INVENTION 

[0006] The present invention solves these and other problems by optimizing the 

display of the image so that a minimal amount of the image is lost while a maximum 

amount of the screen area is used to display the image. By so doing, the high definition 

image can be made larger without losing all of edges of the picture. 

[0007] According to one aspect of the present invention, a method for displaying a 

16:9 aspect ratio image on a 4:3 aspect ratio screen provides that the image is 

proportionally increased so that approximately 13% of the image is lost at the sides while 

approximately only 13% of the screen is unused at the top and bottom. In tiiis method, 

the amount of the unused screen is approximately equal to the amount of lost image. 
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[0008] According to another aspect of the present invention, a method for displaying 
a 4:3 aspect ratio image on a 16:9 aspect ratio screen provides that the image is 
proportionally increased so that approximately 13% of the image is lost at the top and 
bottom while approximately only 13% of the screen is unused at the sides. In this method 
as well, the amount of the unused screen is approximately equal to the amount of lost 
image. Thus, the amount of screen used is maximized while the amount of image lost is 
minimized. 

[0009] According to yet another aspect of the present invention, the viewer can 
control the scaling ratio of the image so that the percentage of lost image varies from zero 
to its maximum, e.g., 25% for a 4:3 aspect ratio image and a 16:9 aspect ratio screen. 
Alternatively, the viewer can control the amount of unused screen from zero to its 
maximum, 25% % for a 16:9 aspect ratio image and a 4:3 aspect ratio screen. In 
other display situations, the exact numbers may vary. 

[0010] Other aspects of the present invention will become apparent to those of skill 
in the art upon a review of the detailed description in light of the following drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] FIG 1 depicts a conventional 4:3 aspect ratio screen displaying a 16:9 aspect 
ratio image. 

[0012] FIG 2 depicts a conventional 16:9 aspect ratio screen displaying a 4:3 aspect 
ratio image. 

[0013] FIG 3 depicts a 4:3 aspect ratio screen displaying a 16:9 aspect ratio image 
according to one aspect of the present invention. 

[0014] FIG 4 depicts a 16:9 aspect ratio screen displaying a 4:3 aspect ratio image 
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according to another aspect of the present invention. 

[0015] FIG 5 depicts an exemplary embodiment of an apparatus for displaying an 
image on a display screen according to yet another aspect of the present invention. 

DETAILED DESCRIPTION 

[0016] It is worthy to note that any reference herein to "one embodiment" or "an 
embodiment" means that a particular feature, structure, or characteristic described in 
connection with the embodiment is included in at least one embodiment of the invention. 
The appearances of the phrase "in one embodiment" in various places in the specification 
are not necessarily all referring to the same embodiment. 

[0017] According to one aspect of the present invention, as shown in FIG 3, a 
letterbox image having an aspect ratio of 16:9 is displayed on a 4:3 aspect ratio screen. In 
this embodiment, a compromise is made between the amount of unused screen and the 
amount of non-displayed image. The image is increased so that the amount of unused 
screen roughly equals the amount of the image that extends beyond the screen. 

16:9 Image and 4:3 Screen 

[0018] Turning to FIG 3, the white portion of the figure represents the 4:3 screen 
whereas the black portion represents the 16:9 image. The 16:9 image has been increased 
beyond the horizontal width or smaller length of the 4:3 screen, but not to the point that 
the image reaches the edge of the vertical or larger length of the 4:3 screen. In general, 
the size of the 16:9 image is now (16+y)(9+^), in which x and y represent the increases in 
the vertical and horizontal directions, respectively. The unused portion of the 4:3 screen 
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now becomes 16x[12-(94-x)]. The ratio of the unused portion of the 4:3 screen to the total 
4:3 screen becomes: 

— — = - — - , which ranges from 0.25 to 0 as x goes from 0 to 3. So, 
12x16 12 ^ 

when the 16:9 image is not stretched at all beyond the width of the 4:3 screen, the total 

lost 4:3 screen percentage is 25%. Thus, the viewer sees 25% of unused 4:3 screen when 

the 16:9 image is not stretched beyond the width of the 4:3 screen. 

[0019] The amount of the 16:9 image that is lost beyond the 4:3 screen becomes 

\2xy. The ratio of the amount of lost 16:9 image to the total 16:9 image becomes: 

= — — , which ranges from 0 to its maximum when x equals 3. 

12 X (16 + J/) 192 + 12:^; 

[0020] The aspect ratio of the 16:9 image must remain 16:9 to prevent distortion. 

Hence, the aspect ratio when x equals 3 is: 

12 9 

= — . Solving for y leads to 3/=48/9 5.33. Thus, ranges from zero to 



16 + 3^ 16 

48/9, which causes the ratio of the lost 16:9 image to range from zero (when;;=0) to 0.25 
(when>^49/8). Thus, the maximum amount of lost 16:9 image is 25% of the total 16:9 
image when the 16:9 image is stretched so that the shorter side fills the entire 4:3 screen. 
[0021] Thus, equalizing the amount of lost 16:9 image to the amount of unused 4:3 
screen gives: 

3-x 12:i; 



12 192 + 12;; 
which gives: 

9 9 + x 



We also have the equation that the aspect ratio must be 1 6:9, 



. This gives 2 equations with 2 unknowns, leading to a solution of: 
16 16 + ;; 
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X = ~9 ± 6 Vs , the only real solution of which is x = -9 + 6 as the other 
solution is negative, which is outside the bounds of the problem statement. The value for 

y then becomes y = "^(""^ y) -^^^ 2.48). The value of the ratio of the 

unused 4:3 screen to the total 4:3 screen area is then: 

3-Jc 3-(-9 + 6V3) 12-6V3 , _ i ^ 

= — = « 0.13 or about 13.4%. Of course, the value of 

12 12 12 

the ratio of the lost 16:9 image to the total 16:9 image is also about 13.4% by definition. 

Thus, by extending the 16:9 image beyond the 4:3 screen somewhat to reduce the unused 

4:3 screen area somewhat, leads to an optimal value of about 13.4% of lost 16:9 image 

area as compared to 25% for a total zoom. 



4:3 Image and 16:9 screen 

[0022] Turning to FIG 4, the white portion of the figure represents the 16:9 screen 
whereas the black portion represents the 4:3 image. In this case, x represents the increase 
in the vertical direction, whereas the expression (I6-3;) represents the change in the 
horizontal direction. The size of the 4:3 image is now {l6-y)(9-^x). The unused portion 
of the 16:9 screen becomes 9x[16-(16->^)]=9>'. The ratio of the unused portion of the 16:9 
screen to the total 16:9 screen becomes: 
9y y 

— — = — , which ranges from 0.25 to 0 as;; goes from 4 to 0 as the 4:3 
9x16 16 

image is stretched to occupy more and more of the 16:9 screen). Four is the maximum y 

can attain as this occurs when the shorter side of the 4:3 image equals the vertical or 

shorter length of the 16:9 screen. So, when the 4:3 image is not stretched at all beyond 

the width of the 16:9 screen, the total lost screen percentage is 25%. Thus, the viewer 
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sees 25% of unused screen when the 4:3 image is not stretched beyond the width of the 
16:9 screen. 

[0023] The amount of the 4:3 image that is lost beyond the 16:9 screen becomes 
(I6-y)>a. The ratio of the amount of lost 4:3 image to the total 4:3 image becomes: 

..9^^ .^^'^ . = — — » which ranges from 0 to its maximum of 0.25 when x 
(l6-y)(9 + x) 9 + x 

equals 3, which occurs whenj; = 0 (f.e,, when the 4:3 image is stretched to the full 
horizontal or longer width of the 16:9 screen). 

[0024] Equalizing the amount of unused 1 6:9 screen to the amount of lost 4:3 image 
leads to: 

y X 



16 9 + x 

whereas the aspect ratio of the 4:3 image must remain 4:3 to prevent distortion, which 
gives: 

3 9 + ;c ^ , . , , 

-7 = — . As we now have two equations and two unknowns, we can solve, 

4 16- y 

which leads to: = 1 6 ± 8 V3 , the only real solution of which is >' = 1 6 - S^fi as the other 
solution is too large, which is outside the bounds of the problem statement. The value for 

X then becomes x = ^^^^^ = ^^"3(16 -8^3) ^ j 39^ 2. 14). The 

value of the ratio of the unused 16:9 screen to the total 16:9 screen area is then: 

V I6-8V3 

77 = — 77 — « 0.13 or about 13.4%. Of course, the value of the ratio of the 
16 16 

lost 4:3 image to the total 4:3 image is also about 13.4% by definition. Thus, by 
extending the 4:3 image beyond the 16:9 screen somewhat to reduce the unused 16:9 
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screen area somewhat, leads to an optimal value of about 13.4% of lost 4:3 image area as 

compared to 25% for a total zoom. It should be noted that the values are the same for 

both the 4:3 image/16:9 screen and the 16:9 image/4:3 screen. 

[0025] According to one aspect of the present invention, the comprise results in 

about a 13% loss of image and about a 13% unused amount of screen. This optimizes the 

amount of lost image and the amount of unused screen. Other amounts of image scaling 

can be used. The main concept is that a portion of the image is lost while a portion of the 

screen remains unused. Typically, the prior versions either maximize the amount of 

unused screen while minimizing the amount of non-displayed image, minimize the 

amount of unused screen while maximizing the amount of non-displayed image, or distort 

the image to show the whole image while occupying the entire screen. 

[0026] Of course, the same technique can be applied when the aspect ratio of the 

image is something other than 4:3 or 16:9 and the aspect ratio of the screen is different 

and perhaps not either 4:3 nor 16:9. In general, the technique is to maximize the use of 

the screen while simultaneously minimizing the loss of image. The above problems can 

be generalized to a situation where the aspect ratio of the image is x:y and the aspect ratio 

of the screen is w:z. As long as the values for jc, y, w and z are known, the above method 

will provide an answer as to the proper values for increasing the image proportionally. 

[0027] According to yet another aspect of the present invention, a viewer can control 

the amount of scaling so that the amount of the image being lost can vary between zero 

and the maximum of image that needs to be lost to fill the entire screen, e.g., 25% for the 

4:3 aspect ratio image being displayed on a 16:9 aspect ratio screen. To accomplish this 

control, a user interface enables the user to select the amount of scaling either by moving 

a slider on a bar, or selecting a value or rotating a tumable knob either in actuality or on 
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an image in a graphical user interface. This is then converted to a voltage or other 
electrical signal that is then provided to the video scaler module, which then adjusts the 
image accordingly. 

[0028] According to yet another aspect of the present invention, a viewer can control 
the amount of scaling so that the amount of the screen not being used can vary between 
zero and its maximum, e.g., 25% for the 16:9 aspect ratio image being displayed on a 4:3 
aspect ratio screen. To accomplish this control, a user interface enables the user to select 
the amount of scaling either by moving a slider on a bar, or selecting a value or rotating a 
tumable knob either in actuality or on an image in a graphical user interface. This is then 
converted to a voltage or other electrical signal that is then provided to the video scaler 
module, which then adjusts the image accordingly. 

[0029] Turning to FIG 5, shown therein is an exemplary embodiment of an apparatus 

50 for displaying an image 52 on a display screen 51 . In this case, the image 52 does not 

have the same aspect ratio as the screen 5 1 . As shown in FIG 5, the screen has an aspect 

ratio of 4:3 while the image has an aspect ratio of 16:9. If the image had the 4:3 aspect 

ratio and the screen had the 16:9 aspect ratio, the figure would look the same, except the 

screen would be represented by the black rectangle and the image would be represented 

by the white rectangle. In other words, the situation is symmetric. 

[0030] In one version of the embodiment, a video scaler controls the size of the 

image so that an amount of the image that is lost (due to the size of the image exceeding 

the screen) roughly equals the amount of the screen that remains unfilled. In this case, the 

portion of the screen 51 that remains unfilled is the upper and lower white areas of the 

screen 51. To be roughly equal, in the 4:3 aspect ratio image being displayed on a 16:9 

aspect ratio screen, the amount of the image that is lost is about 13% of the total image, 

-9- 



Docket: 50T5386.01 



and the amount of the screen that remains unused is about 13% of tfie total screen. Other 
values will exist for different aspect ratio images and different aspect ratio screens. The 
video scaler can exist in a set-top box, an audio/video receiver, a computer card or a 
television, depending upon the application. 

[0031] Although various embodiments are specifically illustrated and described 
herein, it will be appreciated that modifications and variations of the invention are 
covered by the above teachings and are within the purview of the appended claims 
without departing from the spirit and intended scope of the invention. For example, 
certain values are discussed for the optimal solution, however, other values could be 
employed without departing from the scope of tiie invention. Furthermore, this example 
should not be interpreted to limit the modifications and variations of the invention 
covered by the claims but is merely illustrative of possible variations. 
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